Method and apparatus for monitoring and adjusting multiple communication services at a venue

ABSTRACT

Aspects of the subject disclosure may include, for example, initiating first and second groups of communication sessions according to testing criteria where the first group of communication sessions is established via a local area wireless access technology utilizing the distributed antenna system and the second group of communication sessions is established via the second radio access technology utilizing the distributed antenna system, and measuring performance data for the first and second groups of communication sessions according to the testing criteria. Other embodiments are disclosed.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a Continuation of and claims priority to U.S. patentapplication Ser. No. 14/319,110, filed Jun. 30, 2014, the contents ofwhich are hereby incorporated by reference into this application as ifset forth herein in its entirety.

FIELD OF THE DISCLOSURE

The subject disclosure relates to a method and apparatus for monitoringand adjusting multiple communication services at a venue.

BACKGROUND

Venues, such as stadiums, arenas and so forth, often have a large numberof users accessing communication services at the same time. This cancreate stress on the communications network, which may not only affectthe users at the venue, but can also affect users outside of the venue.Service providers can attempt to alleviate the stress on thecommunications network, but this can be difficult given the number ofdifferent services being utilized and the large number of users that arebeing affected.

BRIEF DESCRIPTION OF THE DRAWINGS

Reference will now be made to the accompanying drawings, which are notnecessarily drawn to scale, and wherein:

FIG. 1 depicts an illustrative embodiment of a communication system thatenables monitoring, evaluating and/or adjusting communication servicesat a venue;

FIGS. 2 and 3 depict illustrative embodiments of block diagramsrepresenting probe devices that can be used in system 100 of FIG. 1;

FIG. 4 depicts an illustrative embodiment of a booting process for aprobe device that can be used in system 100 of FIG. 1;

FIG. 5 depicts an illustrative embodiment of a block diagram for acontroller for a probe device that can be used in system 100 of FIG. 1;

FIG. 6 depicts an illustrative embodiment of a block diagram for asoftware agent for a probe device that can be used in system 100 of FIG.1;

FIG. 7 depicts an illustrative embodiment of test cases that can beutilized by a probe device that can be used in system 100 of FIG. 1;

FIG. 8 depicts an illustrative embodiment of a method used in portionsof the system described in FIG. 1; and

FIG. 9 is a diagrammatic representation of a machine in the form of acomputer system within which a set of instructions, when executed, maycause the machine to perform any one or more of the methods describedherein.

DETAILED DESCRIPTION

The subject disclosure describes, among other things, illustrativeembodiments for a probe device(s) for measuring and communicatingperformance test results of communication services provided by a venueDistributed Antenna System (DAS) cellular network and/or local areawireless networks (e.g., WiFi) to one or more service servers.Adjustments to the DAS and/or network parameters for a network providingservices to the venue can be made based on the performance test results.The probe device(s) can be in communication with a management portalserver(s) for receiving various information including testing criteria(e.g., test suites that indicate one or more of types of data to obtain,types of tests to perform, types of communication services to test,testing schedules, and so forth), software updates, recover commands toassist other probe devices following a failure of the other probedevice, and so forth.

In one or more embodiments, the probe device can measure the performanceof wireless networks in near real-time, and in a non-intrusive manner sothat the testing itself does not degrade the system performance. Theprobe device is flexible enough to work with multiple forms of radiotechnology including cellular as well as 802.11 networks, and allows forthe use of different types of antennas. The probe device can operate ineither indoor or outdoor environments and is cost effective.

In one or more embodiments, the probe device is a small, low power,Advanced Reduced Instruction Set Computer (RISC) Machine (ARM)microprocessor based unit that functions as a wireless probe. The probedevice can include a weather-resistant enclosure configured for wall orpole mounting, such as in exposed environments. The probe device caninclude a hardwire interface for an Ethernet link and/or receiving powerover its Ethernet link, such as via a Power Over Ethernet (PoE)mechanism (e.g., IEEE 802.3af compliant device). For instance, theEthernet interface can be a single interface of the probe device thatcan receive power (e.g., via a PoE methods and components), can receivecommand signals from a remote device (e.g. a management portal server)enabling management of the probe device 150, and can provide test datato a remote device (e.g., a database).

In one or more embodiments, the probe device via communication with oneor more other devices (e.g., the service server, a management portalserver, a database server, and so forth) can provide measurable qualityof service statistics through monitoring of multiple wireless services(e.g., Long Term Evolution (LTE), Universal Mobile Telecommunications(UMTS), Global System for Mobile (GSM), Global Position System (GPS),WiFi, World interoperability for Microwave (WiMAX), and others) duringevents at venues (e.g., football or basketball game) to ensure that theDAS is functioning correctly to support end user devices, where voicecalls, text messaging with attachments, photos, videos, or social mediasites may be updated by large numbers of users simultaneously during theevent.

In one or more embodiments, the probe device can perform a series ofautomated tests on a user-specified schedule by initiating voice calls,sending and receiving Short Message Service (SMS) and MultimediaMessaging Service (MMS) messages, and performing Hypertext TransferProtocol (HTTP) and/or File Transfer Protocol (FTP) uploads anddownloads through the DAS network at the venue. This test data can beused, such as by the probe device and/or by a network server, to mapsystem performance to specific areas of the venue.

In one or more embodiments, a system can utilize a group of the probedevices at a venue to obtain test results for various communicationservices provided at the venue. Based on the test results, utilizationof network resources and/or network performance can be evaluated andvarious parameters of the DAS network and/or macro cell(s) can beadjusted to provide improved network performance and a better userexperience in the coverage area provided by the DAS network.

Other embodiments are described in the subject disclosure. Otherembodiments that can be used in whole or in part with the embodimentsdescribed herein are described in co-pending U.S. Patent Applicationentitled “A Method and Apparatus for Managing Wireless Probe Devices”which has Ser. No. 14/318,944, the disclosure of which is incorporatedherein by reference in its entirety.

One embodiment of the subject disclosure includes a probe device havinga first wireless interface that enables communications via a first localarea wireless access technology, a second wireless interface thatenables communications via a second radio access technology, a processorcoupled with the first and second wireless interfaces, and a memory thatstores executable instructions. The processor, when executing theexecutable instructions, performs operation including receiving testingcriteria from a management portal server. The processor can initiatefirst and second groups of communication sessions according to thetesting criteria, where the first group of communication sessions isestablished via the local area wireless access technology utilizing adistributed antenna system, and where the second group of communicationsessions is established via the second radio access technology utilizingthe distributed antenna system. The processor can measure performancedata for the first and second groups of communication sessions accordingto the testing criteria.

One embodiment of the subject disclosure is a method includingreceiving, by a system including a processor, performance data from aprobe device, where the performance data is for first and second groupsof communication sessions initiated by the probe device, where theperformance data is measured according to testing criteria, where thefirst group of communication sessions is established via a local areawireless access technology utilizing a distributed antenna system, andwhere the second group of communication sessions is established via asecond radio access technology utilizing the distributed antenna system.The method can include analyzing, by the system, the performance data.The method can include adjusting, by the system, the distributed antennasystem, a network providing communication services to a location wherethe probe device is positioned, or a combination thereof. The adjustingcan be based on the analyzing of the performance data.

One embodiment of the subject disclosure includes a machine-readablestorage medium, having executable instructions that, when executed by aprocessor of a probe device, facilitate performance of operations,including initiating, by a first wireless interface of the probe device,a first group of communication sessions according to testing criteria,where the first group of communication sessions is established via alocal area wireless access technology utilizing a distributed antennasystem. The processor can initiate, by a second wireless interface ofthe probe device, a second group of communication sessions according tothe testing criteria, where the second group of communication sessionsis established via a second radio access technology utilizing thedistributed antenna system. The processor can establish a first threadfor the first wireless interface and a second thread for the secondwireless interface. The processor can measure first performance data forthe first group of communication sessions according to the testingcriteria utilizing the first thread. The processor can measure secondperformance data for the second group of communication sessionsaccording to the testing criteria utilizing the second thread. Theprocessor can provide the first and second performance data to a networkserver to enable adjustment of the distributed antenna system,adjustment of a network providing communication services to a locationwhere the probe device is positioned, or a combination thereof.

FIG. 1 depicts an illustrative embodiment of system 100 that enablesmonitoring, evaluating and/or adjusting communication services at avenue 110 that includes various areas (e.g., seating areas, concessionareas, walkways, and so forth) where users can access communicationservices using end user devices (not shown), such as mobile smartphones, laptop computers, Personal Digital Assistants (PDAs) or otherdevices capable of wireless communications. The venue 110 can be varioustypes of venues including a stadium, an area, a building, and so forth.In this example, the venue 110 has a DAS 120 with a group of antennas125 to facilitate communications in the venue. The DAS 120 can be anindoor deployed system (iDAS) and/or an outdoor deployed system (oDAS).The DAS 120 can utilize various components (in various configurations)and/or various techniques for spatially separating antenna nodes withrespect to the venue 110, including passive splitters and/or feeders,and/or active-repeater amplifiers to overcome feeder losses. In one ormore embodiments, delays may be introduced between antenna elements toartificially increase delay spread in areas of overlapped coverage,permitting quality improvements via time diversity.

System 100 can include a group of probe devices 150 that are positionedat various areas of the venue for monitoring communication servicesaccessible in these areas. System 100 can also include a managementportal server 160, a network 175 (e.g., a Radio Access Network (RAN)including a Network Operations Center (RAN NOC) 180), a service server190, and a database server 195 (e.g., an SQL database server). In one ormore embodiments, the probe device 150 can communicate with themanagement portal server and/or the service server 190 via a hardwireinterface (e.g., interface 117) through use of routers and a site switchsuch as a Smart Integrated Access Device (SIAD) 155. For instance,interface 117 can be used as a command interface that enables remotemanagement or control over the probe device 150, such as throughreceiving command signals from a remote device (e.g., the managementportal server 160). In another embodiment, the interface 117 can also beutilized for providing power to the probe device 150. The probe device150 can perform a series of automated tests, such as according to a userspecified schedule, by initiating voice calls, sending and receiving SMSand MMS messages, and/or performing HTTP and/or FTP uploads and/ordownloads through the DAS 120 in order to enable mapping (e.g., by theprobe devices 150, by the management portal server 160 and/or by theservice server 190) of system performance to specific areas of the venue110.

In one or more embodiments, the probe devices 150 can be mounted orotherwise affixed to infrastructure of the venue, such as a wall orceiling, or can be positioned on a pole at a height that preventstampering or otherwise contact with persons. As an example and referringadditionally to FIG. 2, the probe device 150 can be a small integratedunit based on an ARM-family processor and associated peripherals, whichsupports Mini-PCIe compliant plugin cellular modems, and a Mini-PCIe802.11 WiFi modem. Other types of modems that operate utilizing otheraccess technology can also be utilized in addition to, or in place of,the modems of FIG. 2. The combination of small size, low power, andflexibility of communications types and bands (e.g., UMTS, GSM, LTE,GPS, and/or WiFi) can enable the probe device 150 to efficiently performQuality of Service (QoS) testing for mobile communication services. Theprobe device 150 can support new or emerging technologies via softwareupdates and/or component updates (e.g., modular components that areremovable from the probe device 150).

In one or more embodiments, all of the onboard communication of theprobe device 150 between the control module and the various modems canbe performed through interconnection of the internal mini-PCIe cellularmodems via USB 2.0 standard interfaces and a multi-port USB hub. In oneor more embodiments, the probe device 150 can support integration of acommercially available mobile handset (e.g., an Android handset) toprovide additional testing capability. In one embodiment, the probedevice 150 can include a single external hardwire connection orinterface, which can provide an Ethernet interface to the service server190 and/or power via PoE circuitry. In one embodiment, the enclosure orhousing can satisfy Telcordia requirements for weather, temperature,dust intrusion, and so forth for enclosures, and can provide industrystandard antenna connections for maximum flexibility in antennaselection.

In one embodiment, the probe device 150 can provide a visual indicator,such as a single, externally-visible LED, that flashes or otherwiseemits an indication in a specified manner to represent operations of theprobe device, such as each time that power is applied after a periodwithout power (e.g., the LED can remain On when the probe device isbooting); a short flash when the IP address is enabled; exhibit a longflash when the operating system is loading and turn Off when the probedevice has been registered with the service server 190 and/or themanagement portal server 160). These LED or other visual indications canbe visible at the time of installation to enable a determination thatthe probe device 150 is functioning before the installation iscompleted.

The probe device 150 can operate using various operating systems, suchas a Linux™ operating system, to provide for flexibility and softwarecompatibility. The probe device 150 can accept external commands, suchas from the management portal server 160 (e.g., via interface 117), forfunctions including starting and stopping the software, rebooting,reporting status and/or enabling the management portal server toremotely initiate an upgrade to the software without a service call. Thesoftware of the probe device 150 can accept Advanced Technology (AT)commands through the diagnostic/maintenance port for administrative ortroubleshooting purposes. In one embodiment, a portal operator via themanagement portal server 160 can upload new or unique test suites toeach probe device 150 at the venue 110, such as based upon the featuresand function that needs to be tested.

Referring additionally to FIG. 3, the functionality of the probe device150 is generally illustrated. The probe device software enablesadministration, testing, and/or reporting of the status of the probedevice itself and the results of the network testing to the serviceserver 190 and the database server 195. The software can also listen forcommands from the management portal server 160 that may change thestatus and/or test regimen of the probe device as it runs on the probedevice platform.

In one embodiment, the probe device software can be composed of severalseparate functions that work together to provide the reliability, testenvironment, and flexibility to support continuous network operations.For example, the probe device boot up sequence as illustrated in FIG. 4can include a first stage boot loader (MLO) that is loaded from ROMwhich in turn loads the second stage boot loader (u-boot). The u-bootcan be modified to allow the download of a kernel from NAND ROM on theboard or from the network using Trivial File Transfer Protocol (TFTP) incase of failure to load from ROM. During the initialization process, anautomatic login can be performed using ttyO0 script. On login, the probedevice 150 can execute a .bashrc script that sets the probe device timezone to UTC and starts a watchdog process which can be a parent process.This sequence of boot-up steps can enable the probe device software toauto-start on every soft and/or hard reboot.

In one embodiment, the probe device software can include a watchdogprocess, which can be, for example, a Linux® process. The probe device150 can create a probe device agent and a controller child process, suchas by using fork and exec routines in Linux. The watchdog process canwait for an exit status of either of these processes using a waitpidprocess. If any of these processes exits with the status EXITED orSIGNALED, it can recreate the process to ensure that the probe deviceagent and controller processes are always active.

In one or more embodiments, the probe device 150 has a controllerprocess that can also be a Linux process and can be a supporting processto the probe device agent. The controller process main function is tosend the status of the probe device 150 to the database server 195 andto the service server 190, and to listen for new commands from themanagement portal server 160. The controller process can be comprised offour elements as shown in FIG. 5. The configuration parser can parse theprobe device configuration file to read the service server URL and theprobe device software FTP URL. The service server URL can be used tosend a heart-beat every two minutes to the service server 190. The probedevice software can be downloaded from the FTP URL. The probe device 150can send a heartbeat to the service server 190 at regular intervals(e.g., every two minutes) to indicate to the service server that theprobe device is alive and online. The command receiver can be a threadwhich runs a TCP listener to receive commands from the management portalserver 160. The command receiver can acknowledge a command request bysending an ACK response back to the management portal server 160. Thecommand controller can parse the command and can determine whether thecommand is to be provided to the controller process or to the probedevice agent for execution. Various commands can be handled or otherwiseprocessed by the controller (via the command handler), such as softwareupdates including downloading and installing the probe device software;probe device reboot including performing a soft boot of the probe device150 which assists in recovering from a condition where the probe devicesoftware is stuck and has become inactive. In one embodiment, all othercommands can be forwarded to the probe device agent.

The probe device agent can be a Linux process and can be a main processof the probe device software which performs tests to capture and measurewireless network performance. The probe device agent can also beresponsible to post the test results to the service server 190. Theprobe device agent can have a number of components illustrated in FIG.6. In one embodiment the probe device agent can have a configurationparser that parses the probe device configuration file to read theservice server URL, test schedule and test case configuration. Theregistration component can perform initialization and registration ofthe probe device 150 to the service server 190. The registrationcomponent expects to detect all or at least one of the LTE modem, UMTSmodem, WiFi modem or Android handset connected to the probe devicehardware. The registration component can read the model, manufacturer,IMEI, ICCID, IMSI, and MSISDN of the LTE and/or UMTS modems. Theregistration component can read the model, manufacturer, IMSI and/orserial number of the Android handset. The registration component canread the model and manufacturer of the WiFi card. The registrationcomponent can also capture the MACID, IP Address, probe device softwareversion, and/or current probe device configuration version of the probedevice 150. All this information can be reported in the registrationrequest. The probe device 150 can perform registration even if none ofthese devices are detected. In one embodiment, if the probe device 150is running a different configuration version than what is mapped in themanagement portal server 160, the registration request's response caninclude a new mapped probe device configuration file. In one embodiment,upon receiving the probe device configuration file, the probe deviceagent can restart to interface with the new configuration file.

The probe device agent can have a peripheral initialization componentthat initializes the LTE modem, UMTS modem, WiFi cards and/or Androidhandsets. All these devices can be connected to the probe device 150 onthe USB host port via the multi-port USB hub so communication with allof the internal devices can occur using a USB protocol. The LTE and UMTSmodem initialization can include setting up a data session with thenetwork and assigning an IP address to the modem interface on the probedevice 150. By setting up a data session at startup, the probe deviceagent can be always ready to perform data related tests on the network;it does not tear down the data session on every test. The probe device150 can also initiate a separate thread for each modem to read theresponse on the AT command interface. WiFi card initialization caninclude scanning of available WiFi hotspots and establishing connectionwith the SSID as configured in the probe device configuration file. Thiscan supports WEP, WPA and WPA2 authentication for connection. Foraccessing a WiFi Services network, the probe device can implement an AAAspecification, and can also run a daemon which processes automaticre-connection to a WiFi hotspot in case the connection fails.

In one embodiment, the WiFi, LTE, and UMTS modems can each create onenetwork interface on the probe device 150, and there can always be anEthernet network interface. In Linux, there may only be one defaultnetwork interface which is used when any application tries tocommunicate with another device. To enable simultaneous communication onthese interfaces without changing from using the Ethernet as the defaultinterface, the probe device agent can perform IP rule setting for eachof these interfaces. In one embodiment, Domain Name Server (DNS)resolution takes place using the Ethernet interface even when using oneof the other three interfaces. The Android handset can have twointerfaces with the probe device agent. The first interface can be overUSB which is used by the probe device agent to communicate with theprobe device 150 using ADB (Android Debug Bridge) and the interface is aGeneral Purpose Interface/Output (GPIO) to control the power ON/OFF ofthe Android handset. During initialization, the probe device agent canuse ADB checks if the Android handset is connected. If the probe deviceagent does not detect the handset, it assumes that it is OFF and canoperate GPIO to perform a power cycle on the Android handset. The probedevice agent can wait and recheck the connection to the Android handset.Once the connection is established, the probe device agent can start theAndroid application which can be later instructed to perform some tests.The probe device agent can use the TCP port to establish socketcommunication with the Android application which can be listening onport 8888.

The probe device agent can have an AT handler that interacts with themodem using AT commands. The AT handler can support sending of ATcommands to the modems, and in reading both solicited and unsolicitedresponses. In one embodiment, there can be a dedicated AT Handler forthe UMTS modem and for the LTE modem. The probe device agent can have atest controller that is responsible for controlling and scheduling thetest execution. The test controller can create a separate thread foreach test execution and can wait for its completion. On completion, thetest controller can create a thread for the next test case. Each testcase has an associated time period during which it is expected tocomplete the test. If a test takes more time, it is abruptly terminatedand the next test execution begins. The test controller can ensure thatthe tests are executed per the test schedule established in the probedevice configuration file received from the management portal server160. The probe device configuration file can support various types ofscheduling including Microsoft® Outlook scheduling. The test controllercan store a sequence ID of the current executing test case and if forany reason the probe device agent experiences a failure, onauto-restart, the probe device 150 can start executing the next testcase in the sequence.

The probe device agent can have a test executor that is responsible fortest execution. Before commencing the actual test, the networkparameters can be captured. After each test execution, the networkparameters can again be captured and stored in a local database (e.g., amemory device integrated into the probe device 150 or coupled thereto)along with the test results.

The test executor can perform various tests on a number of communicationsessions utilizing various wireless access technologies. The tests caninclude a voice test, SMS test, MMS test, HTTP download goodput test,HTTP download throughput test, HTTP upload goodput test, HTTP uploadthroughput test, FTP download test, FTP upload test, PDP contextestablishment test, ping/latency test, microburst test and/or DNSresolution test.

The probe device agent can have a database manager which can be aSQLite® database application for storing the test results. For example,the database can be created on an SD card. The data can have two parts:test suite related data and test case related data. There can be one ormore test cases in one test suite. Data can be stored in JSON encodedformat in the database which is in the same format used for posting datato the service and database servers 190, 195. This can assist inavoiding re-encoding of the data while posting a previously failed postto the database server 195. After each successful post to the databaseserver 195, the corresponding data can be deleted from the localdatabase. If the posting of data to the database server 195 fails, thedata can be retained in the local database and can be queued to beretried for posting later.

The probe device agent can have a command handler. The probe deviceagent can process various commands such as via the command handler(e.g., commands received from the management portal server 160): stopprobe device service—stops the probe device agent from executing anytest and the probe device then goes into IDLE state; start probe deviceservice—starts the probe device agent and places the probe device in anACTIVE state; start monitor—this command instructs the probe deviceagent to send the test results after each test execution is completedand this command is sent by the management portal server when a user isviewing the dynamic status of the probe device; stop monitor—thiscommand instructs the probe device agent that the probe device's statusis no longer being viewed dynamically so the probe device agent shouldstop sending the test results at end of each test execution; streamsoftware update—updates the application on the Android handset; streamreboot—reboots the Android handset connected to the probe device; streamstart application—starts the application on the Android handset; streamstop application—stops the application on the Android handset; streampower cycle—power cycles the Android handset via the probe device agentinitiating a GPIO to power cycle the optional handset; status post—poststhe current status of the probe device (Active/Idle) to the databaseserver 195; result post—posts the test results to the database server195; and/or log post—posts the debug logs to the database server 195 fortroubleshooting.

In one embodiment, the probe device 150 can utilize a configurationfile, such as in JSON format, that includes a registration URL and portnumber of the service server 190; test scheduling that allows settingthe schedule for testing and which includes options for calendarinvites; test case details including details of the test case to beperformed by the probe device such as test ID, technology, metadataspecific to the test, and/or timeout, and where the test cases can belisted in the order in which they are expected to be executed by theprobe device; and/or a maximum size of log file where the probe devicecan purge the log file once it reaches this size.

In one embodiment, the probe device 150 can utilize a probe devicerecovery mechanism to address a failure of the probe device, such as inbooting up. If the probe device is not able to boot up, it can becomeinaccessible remotely using Secure Shell (SSH) commands or telnet, andit may not perform testing. In one embodiment, another probe device thatis properly functioning can be used to recover the faulty probe devicein a same venue. For example, the management portal server 160 can senda command to the properly functioning probe device to change its rolewhich sets an alias IP address such as 192.168.0.1. The managementportal server 160 can send a command to the faulty probe device to powercycle. Upon boot up, the faulty probe device can sets its IP address as192.168.0.2 and can download a kernel and a root file system from theproperly functioning probe device at IP address 192.168.0.1 to recoveritself.

Referring back to system 100 of FIG. 1, the system provides measurablequality of service statistics through the testing and monitoring ofwireless services (e.g., LTE, UMTS, GPS, and WiFi) using the probedevices 150 and the service software described above. The probe devices150 each execute a series of test scripts (the same scripts or differentscripts) that are part of a test suite that tests network services, suchas voice, MMS and SMS messaging, location-based services, loading, softhandoff, bandwidth, and other criteria associated with the DAS 120. Theprobe devices 150 can communicate through routers (not shown) andutilizing a site switch (e.g., SIAD 155), which can transfer the testresults data and other network information to the database server 195 tostore the test information. In one embodiment, the system 100 canautonomously monitor the database of test data and can evaluate keyperformance indicators and send alarm to the management portal server160 and/or to the RAN NOC 180 to alert them to a change in theperformance status of the probe devices 150. In one embodiment, theservice server 190 can analyze the test data and may determine whethercertain threshold(s), associated with key performance indicators thatare unique to the network, such as corresponding to a soft handover rateor latency, are being met.

In one embodiment, the system 100 can use a REpresentational StateTransfer (REST) RESTful Web service. The communication can be over thesecure HTTPS protocol. Data can be exchanged in JavaScript ObjectNotation (JSON) format. Probe device postings can be in a distributedarchitecture. Bi-directional communication can be performed with theprobe devices 150. Synchronization can be performed of the time used bythe probe devices 150 in reporting test activities with the standardserver UTC time. Registration of the probe devices can be performed.Updates can be performed for the database 195 with the test resultsdata. Purging of the database 195 can be performed at regular intervals.Notification messages can be sent when a probe device 150 is Offline orInactive. Notification messages can be provided when any of the servers(e.g., management portal server 160, service server 190 and databaseserver 195) is down or otherwise not functioning properly. Notificationmessages can be sent if the site switch (e.g., SIAD 155) is down orotherwise functioning improperly. Probe device Ethernet status can beshown or otherwise indicated as Online/Offline and activity status asActive/Idle/Inactive.

In one embodiment, the service server 190 can be a primary interface tothe database server 195, which supports the central database with whichthe other devices and servers (service server 190, management portalserver 160, and probe devices 150) interact. In one embodiment, theprobe devices 150 can report completion of the test suite to the serviceserver 190 and can post updates to the database server 195 causing theservice server 190 to notify the management portal server that the testresults information has been updated. In this example, the managementportal server 160 can retrieve the new information from the database195. Continuing with this example, the probe devices 150 may not responddirectly to the management portal server commands.

System 100, through use of active monitoring of communication servicesat the venue, enables adjustments to the coverage of the antenna systemof the DAS 120 that can increase performance, such as in certain highusage load areas, thereby increasing call performance and customersatisfaction. Based on the test data collected by the probe devices 150and stored on the database server 195, when the performance of the DAS120 reaches a specified threshold, alarms can be issued such as to thenetwork control component in the RAN NOC 180. These alarms, or othernotification information resulting from an analysis of the test resultsof the probe devices 150, can be used to dynamically adjust parametersassociated with neighboring macro cell towers and/or the DAS 120 insidethe venue to increase performance. These changes or adjustments caninclude: increasing or decreasing antenna amplification at the macrotower; adding spectrum; changing antenna tilt to provide bettercoverage; and/or splitting antenna coverage areas to balance the load.In one or more embodiments, the RAN NOC 180 can perform a number ofmitigation strategies according to the test results of the probe device150: remotely changing antenna amplification; adjusting antenna tilt inthe affected DAS sector(s); adding antennas in the affected DASsector(s); and/or bisecting DAS sector(s) into additional DAS sectors todecrease the number of users on each antenna. Other parameters can alsobe adjusted to improve or otherwise alter system performance accordingto the test results of the probe devices 150 depending on the particularsystem and the parameters available to tune system performance.

FIG. 8 depicts an illustrative embodiment of a method 800 that can beused by a system (e.g., system 100) for monitoring, analyzing andadjusting communications services, such as at venue 110. Method 800 cancommence at 802 where testing criteria is obtained by a group of probedevices 150. The testing criteria can be the same for each of the probedevices 150 or can be different testing criteria depending on a numberof factors including the position of the probe device within the venue,the testing capabilities of the probe device, and so forth. The testingcriteria can include various information such as the schedule forexecuting the tests, the type of communication services to be tested,the types of tests to be executed, the types of data to be collected,and so forth. In one embodiment, the testing criteria can be receivedfrom the management portal server 160. In another embodiment, thetesting criteria can be received from another source, such as anotherprobe device. In one embodiment, the probe devices 150 can communicatewith each other to identify testing criteria, such as identifying aschedule for testing. In another embodiment, the probe devices 150 canbe in a master-slave arrangement where one (or a subset) of probedevices 150 determine or otherwise generate testing criteria for theremaining probe devices.

At 804, the probe devices 150 can initiate communication sessionsaccording to the testing criteria. The communication sessions can bevoice, messaging, video and/or data services utilizing various wirelessaccess technologies including LTE, UMTS, GSM, GPS, WiFi, and so forth.At 806, testing can be performed by the probe devices 150 to obtainperformance data. Examples of types of tests that can be performed bythe probe devices 150 are illustrated in FIG. 7. In one embodiment, someor all of the initiation of the communication sessions and/or thetesting can be performed simultaneously or overlapping in time utilizingthe multiple modems integrated into the probe devices 150. In oneembodiment, the testing can be done utilizing separate threads for eachmodem.

At 808, a determination can be made as to whether a connection to anetwork server (e.g., service server 190 and/or database server 195)exists. For example, each probe device 150 can have a single hardwireinterface enabling an Ethernet connection via SIAD 155 to the networkserver. If the connection does not exist or is otherwise determined tobe unavailable for use by the probe device 150, the probe device canlocally store the performance data and continue to perform tests on thevarious communication services at the venue 110. Once the connectionwith the network server is restored (or if the connection was determinedto be available), the performance data (or a portion thereof) can betransmitted at 812 for storage by the database server 195.

The stored performance data can be analyzed at 814 (e.g., by themanagement portal server 160) to identify the performance of the DAS 120with respect to each of the communication services over the differentwireless access technologies. If the QoS or other performance thresholdis satisfactory then method 800 can return to 804 to continue themonitoring and collection of test data by the probe devices 150. If onthe other hand, the performance of the DAS 120 is below a QoS thresholdor below some other performance threshold then adjustments can be madeat 816 to improve or otherwise alter the performance associated with oneor more of the communication services over one or more of the wirelessaccess technologies. For example, alarms may be issued to the RAN NOCfor dynamically adjusting parameters associated with the neighboringmacro cell towers and the DAS antenna system inside the venue toincrease performance. As another example, the system 100 can increase ordecrease antenna amplification at the macro tower, add spectrum, changeantenna tilt to provide better coverage, or split antenna coverage areasto balance the load. Other examples of mitigation actions responsive todetected performance issues include remotely changing antennaamplification, adjusting antenna tilt in the affected DAS sector(s),adding antennas in the affected DAS sector(s), and/or bisecting DASsector(s) into additional DAS sectors to decrease the number of users oneach antenna.

Multiple forms of media services can be offered to end user devices atthe venue 110 including voice, video messaging and/or data according tovarious wireless access protocols such as GSM, Code Division MultipleAccess or CDMA, Time Division Multiple Access or TDMA, UMTS, WiMAX,Software Defined Radio or SDR, LTE, WiFi, WiMAX and so on. Other presentand next generation wide area wireless access network technologiesand/or local area wireless access technologies can be used in one ormore embodiments of the subject disclosure.

In one or more embodiments, tracking and validating the correctoperation of the hardware and software for each probe device can beperformed as the probe device goes through the manufacturing andacceptance test phases before installation in a live venue. For example,a test server system can be utilized as part of the manufacturing andacceptance process for each of the probe devices 150. The test serversystem can have a blend or portions of the three server (managementportal server 160, service server 190 and database server 195) softwaresuites to enable a full range of functional tests on the probe devicesas they complete the manufacturing process. The test server system canhave similar functionality to the management portal server 160 in orderto test the probe devices 150 before they are deployed to the field. Thetest server system can have the ability to work continuously and caninclude the ability to auto-start the software once the system boot iscomplete. The test server system can have the ability to auto recoverfrom a failure condition, and can provide support for various wirelesstechnology testing including WiFi, LTE, UMTS and GSM.

The test server system can track the manufacturer and model of each ofthe installed radio modules of the probe devices 150, their associatedSIM cards and the activation of its' International Mobile SubscriberIdentity (IMSI), International Mobile Equipment Identity (IMEI),International Communications Committee Identity (ICCID), and MobileSubscriber Integrated Services Digital Network Number (MSISDN). The testserver system can also perform the functions of the service server 190of registering and identifying the probe device 150 and recording theICCID, MSISDN, and SIM card data for each of the modems, wirelessaccount activation for the UMTS modem, LTE modem, and the integratedhandset, verifying the correct software version, initializing the testsuite and monitoring the test suite completion. The probe device 150 canrun the assigned test suite for a specified burn-in period during finalmanufacturing testing and report the results to the test server system.The service server 190 can store all of the collected test results dataon the database portion of the server.

In one embodiment, the test server system can perform some of thefunctions of the database server 195 to create a database record of theconfiguration of each new probe device 150 including: ICCID, MSISDN, andSIM card tracking by serial number, MAC address of the processor board,modem model identification and serial numbers, software version number,and test data as the probe device undergoes final testing at themanufacturing site. The test server system can record this informationand can send a notification to the management portal software that thedatabase data has been updated and is available for review. At thispoint, the management portal software can create a new test suite forthis probe device 150 or assign an existing test suite for thefunctional testing of the probe device. The test server system canmonitor the software version installed on each probe device 150 toensure that it is the latest released version. The portal software cancontrol how many times each test of the test suite is run on the probedevice 150 and the time period between each different use-case test thatis part of the test suite and each iteration of that use-case duringacceptance testing. The test suite run on each probe device 150 canconsist of multiple use-cases and each can be run multiple times asspecified in the portal software. As each probe device 150 completes themanufacturing cycle, the portal can assign a test suite and those testresults and the time of completion can be recorded along with the testresult data to ensure that all of the major functional pieces of theprobe devices are performing as specified for acceptance by a serviceprovider. An example of use-case tests that may be used to build a testsuite is shown in FIG. 7. Not all of the available use cases need to beused in each test suite and the test suite contents can depend upon anumber of different factors including the modem types installed in theprobe device 150.

Active testing at the manufacturing and acceptance test phase for eachproduction probe device 150 can ensure that the highest quality andlatest versions of the probe devices are available in the venues 110 tomonitor the DAS 120. The use of a test server system enables: remotelymanage probe devices; since the portal is web based, any user havingproper privileges in the portal and access to the network can access theportal from a PC, tablet, cell phone, or other connected mobile deviceand is not access platform dependent; able to perform automated testingaround the clock to keep the new production probe device's qualitystandards high; analyze the test results in a graphical manner based onwhich technology is being monitored; create and edit custom test suitesfor expanded testing of the probe devices before delivery; download theuse-case test suites to the probe devices remotely; update the probedevice software remotely; probe device tests can be monitored in nearreal-time, thus enabling the user to know the current status of theacceptance testing of each probe device and adjust the testing if anyweak performing areas are identified during the tests; ability tosupport testing on at least two radios simultaneously; probe deviceauto-registration with the service section of the test server systemtests the operation of the registration routine, where upon successfulboot up the probe device begins reporting test results to the databaseportion of the server and then reporting the availability of the testresults to the portal software when requested by the acceptance testoperator. The portal software allows management of the test suite andtest scheduling. Remote management of the probe devices 150 is enablesincluding reboot, power cycle, stop service, and start service. Theprobe device status can be shown as Online or Offline and the state asActive, Idle, or Inactive.

Upon reviewing the aforementioned embodiments, it would be evident to anartisan with ordinary skill in the art that said embodiments can bemodified, reduced, or enhanced without departing from the scope of theclaims described below. For example, one or more of the components(e.g., the probe device, the management portal server and/or the serviceserver) can be utilized for monitoring, evaluating and adjustingcommunication services at a venue that does not include a DAS.

Active monitoring of the DAS 120 of the venue 110 allows adjustments tothe coverage of the antenna system that can increase performance incertain high load areas thereby increasing communication serviceperformance and customer satisfaction. Remote management of the probedevices 150 through the management portal server 160 can include autorecovery of firmware/software failures so that physical intervention isnot required; monitoring test results posted over a reliable Ethernetnetwork; enabling troubleshooting using SSH; scheduling testing hourly,daily, weekly, or monthly; retaining data on the probe device to avoidloss of data in the event that the probe device cannot download the testresults to the database server; remotely configurable test execution tobe able to change the test suite as conditions change at the venue; autoregistration on startup for probe device detection; real time statusupdates being available on the management portal server by using a startmonitoring command; supporting a scalable architecture to support newmodem and technology with minimum changes to the software; supportingself-diagnostic testing to discover errors (hardware/assembly) duringmanufacturing; remotely managing Android handsets through the probedevice software; providing technology agnostic monitoring to supportfuture growth in communications technology; a scalable protocol tosupport additional test parameters without modification to the softwareinterface; supporting and controlling a probe device's ability to switchroles because it can act as a monitor to perform network testing or as aresponder to serve as an auto-reply system for multimedia and SMS textmessages, or as a mender to use to download the correct software torecover an unresponsive probe device; the ability to support testing onmultiple integrated radios simultaneously; the ability to remotelyupgrade the probe device software as well as firmware.

In one or more embodiments, the probe device software can continuouslyrun and can include the ability to auto-start once the system boot iscomplete. The probe device can: auto recover from a failure condition;facilitate configuration; provide support for various accesstechnologies (e.g., WiFi, LTE, UMTS, and GSM); provide an easy means tosupport new technologies and new communications bands; and provide theability to communicate over Ethernet and wireless network interfacessimultaneously. The probe device can be remotely configurable from themanagement portal server, and have the ability to upgrade the softwareremotely. The portal device can: process commands from the managementportal server; register with the management portal server; synchronizethe date and time with the management portal server; communicate with anAndroid handset over ADB (Android debug bridge); power cycle an Androidhandset using General Purpose Input Output (GPIO) pins; store testresults in a local database in case of an error in reporting the testresults to the service server or the database server; report the testresults to the database server over Ethernet; report various requestedor required network parameters including RSSI (received signal strengthindication), SINR (Signal to Interference plus Noise Ratio), BER (biterror rate), Reference Signal Received Power (RSRP), Reference SignalReceived Quality (RSRQ), band; measure performance of voice call, SMS,MMS, Packet Data Protocol (PDP) Context Establishment, latency, HTTP/FTPupload/download throughput/goodput, DNS resolution time; apply amicroburst method of measuring upload and download throughput; and/orapply a speed test method of measuring upload and download throughput.

The collection of test results from the probe devices situated indifferent areas of the venue allows the RAN operators to identify whichparts of the system are suffering degraded performance and enables themto make the appropriate adjustments in that area to resolve the problemwithout disrupting other technology types or coverage areas.

In one or more embodiments, the probe devices can operate independentlyand autonomously without centralized control. Various data compilationtechniques can be utilized including a tree or hierarchy for testresults. The probe device can be physically located in a particularsector of a venue and the probe device can know which sector and whichmacro cell tower it is associated with. Sector density may be differentin different regions of a venue. Sector locations can distinguish areasof a venue, such as seating area from a concession area. The probedevices can be used to monitor traffic in a particular region of thevenue depending upon event timing, such as the probe device focused onmonitoring seating areas during periods of a game and can focus onconcession/lobby areas during intermission before/after game. Whenmaking a change to a network, the probe devices may perform moreaggressive testing, e.g., to verify a particular change was effective.Such probe device routines can be classified as “special” routines,meaning they would only be implemented during special circumstances,such as a network change. API's can be used to interface with managementportal server or other network servers. Data can be collected from othercarriers by the probe devices. In a comparative mode, more than oneprobe device can be implemented within each sector, e.g., two probedevice to allow simultaneous testing to be performed—same test casestarted at the same time. In this example, a comparison between testresults can be made to verify accuracy of data.

The exemplary embodiments can be applied to cell towers. Power can beprovided on a POTs line, e.g., on a telephone pole. In one or moreembodiments, the probe devices do not contain a battery. In otherembodiments, a backup power source can be used, such as a battery or ahardwire connection with another power source. The antennas on the probedevice can be positioned and spaced apart to enable simultaneousoperation (Simop) of different modems. In one embodiment, particularprobe devices can be located based on the management portal serverremotely turning on the LED indicator of the particular probe device. Inone or more embodiments, a venue can have more than one DAS (e.g., afirst service provider DAS, a second service provider DAS, and a thirdparty DAS).

In one or more embodiments, the test results collected enable acomparison of services between different service providers at the samevenue. In one embodiment, test results can be shared between probedevices so that data verification for accuracy can be performed locallyby the probe devices. In one embodiment, other data can be collected aspart of the services analysis for the venue, such as network traffic,network resource usage, historical network traffic, historical resourceusage, predicted network traffic, and predicted resource usage for thenetwork surrounding or in proximity to the venue. In one or moreembodiments, mitigation strategies resulting from an analysis of thetest probe performance data can include adjusting network parameters toachieve a compromise in performance of different services at the venue.In one embodiment, an analysis of test results collected from the probedevices can be used for generating testing criteria (e.g., types oftests, types of data to be collected, and/or schedules for the test) tobe provided to the same or different probe devices for future testing.

Other embodiments can be used in the subject disclosure.

It should be understood that devices described in the exemplaryembodiments can be in communication with each other via various wirelessand/or wired methodologies. The methodologies can be links that aredescribed as coupled, connected and so forth, which can includeunidirectional and/or bidirectional communication over wireless pathsand/or wired paths that utilize one or more of various protocols ormethodologies, where the coupling and/or connection can be direct (e.g.,no intervening processing device) and/or indirect (e.g., an intermediaryprocessing device such as a router).

FIG. 9 depicts an exemplary diagrammatic representation of a machine inthe form of a computer system 900 within which a set of instructions,when executed, may cause the machine to perform any one or more of themethods described above. One or more instances of the machine canoperate, for example, as the probe device 150, the management portalserver 160, the service server 190, and/or the database server 195 andother devices described herein In some embodiments, the machine may beconnected (e.g., using a network 926) to other machines. In a networkeddeployment, the machine may operate in the capacity of a server or aclient user machine in a server-client user network environment, or as apeer machine in a peer-to-peer (or distributed) network environment.

The machine may comprise a server computer, a client user computer, apersonal computer (PC), a tablet, a smart phone, a laptop computer, adesktop computer, a control system, a network router, switch or bridge,or any machine capable of executing a set of instructions (sequential orotherwise) that specify actions to be taken by that machine. It will beunderstood that a communication device of the subject disclosureincludes broadly any electronic device that provides voice, video ordata communication. Further, while a single machine is illustrated, theterm “machine” shall also be taken to include any collection of machinesthat individually or jointly execute a set (or multiple sets) ofinstructions to perform any one or more of the methods discussed herein.

The computer system 900 may include a processor (or controller) 902(e.g., a central processing unit (CPU)), a graphics processing unit(GPU, or both), a main memory 904 and a static memory 906, whichcommunicate with each other via a bus 908. The computer system 900 mayfurther include a display unit 910 (e.g., a liquid crystal display(LCD), a flat panel, or a solid state display). The computer system 900may include an input device 912 (e.g., a keyboard), a cursor controldevice 914 (e.g., a mouse), a disk drive unit 916, a signal generationdevice 918 (e.g., a speaker or remote control) and a network interfacedevice 920. In distributed environments, the embodiments described inthe subject disclosure can be adapted to utilize multiple display units910 controlled by two or more computer systems 900. In thisconfiguration, presentations described by the subject disclosure may inpart be shown in a first of the display units 910, while the remainingportion is presented in a second of the display units 910.

The disk drive unit 916 may include a tangible computer-readable storagemedium 922 on which is stored one or more sets of instructions (e.g.,software 924) embodying any one or more of the methods or functionsdescribed herein, including those methods illustrated above. Theinstructions 924 may also reside, completely or at least partially,within the main memory 904, the static memory 906, and/or within theprocessor 902 during execution thereof by the computer system 900. Themain memory 904 and the processor 902 also may constitute tangiblecomputer-readable storage media.

Dedicated hardware implementations including, but not limited to,application specific integrated circuits, programmable logic arrays andother hardware devices can likewise be constructed to implement themethods described herein. Application specific integrated circuits andprogrammable logic array can use downloadable instructions for executingstate machines and/or circuit configurations to implement embodiments ofthe subject disclosure. Applications that may include the apparatus andsystems of various embodiments broadly include a variety of electronicand computer systems. Some embodiments implement functions in two ormore specific interconnected hardware modules or devices with relatedcontrol and data signals communicated between and through the modules,or as portions of an application-specific integrated circuit. Thus, theexample system is applicable to software, firmware, and hardwareimplementations.

In accordance with various embodiments of the subject disclosure, theoperations or methods described herein are intended for operation assoftware programs or instructions running on or executed by a computerprocessor or other computing device, and which may include other formsof instructions manifested as a state machine implemented with logiccomponents in an application specific integrated circuit or fieldprogrammable gate array. Furthermore, software implementations (e.g.,software programs, instructions, etc.) including, but not limited to,distributed processing or component/object distributed processing,parallel processing, or virtual machine processing can also beconstructed to implement the methods described herein. It is furthernoted that a computing device such as a processor, a controller, a statemachine or other suitable device for executing instructions to performoperations or methods may perform such operations directly or indirectlyby way of one or more intermediate devices directed by the computingdevice.

While the tangible computer-readable storage medium 922 is shown in anexample embodiment to be a single medium, the term “tangiblecomputer-readable storage medium” should be taken to include a singlemedium or multiple media (e.g., a centralized or distributed database,and/or associated caches and servers) that store the one or more sets ofinstructions. The term “tangible computer-readable storage medium” shallalso be taken to include any non-transitory medium that is capable ofstoring or encoding a set of instructions for execution by the machineand that cause the machine to perform any one or more of the methods ofthe subject disclosure. The term “non-transitory” as in a non-transitorycomputer-readable storage includes without limitation memories, drives,devices and anything tangible but not a signal per se.

The term “tangible computer-readable storage medium” shall accordinglybe taken to include, but not be limited to: solid-state memories such asa memory card or other package that houses one or more read-only(non-volatile) memories, random access memories, or other re-writable(volatile) memories, a magneto-optical or optical medium such as a diskor tape, or other tangible media which can be used to store information.Accordingly, the disclosure is considered to include any one or more ofa tangible computer-readable storage medium, as listed herein andincluding art-recognized equivalents and successor media, in which thesoftware implementations herein are stored.

Although the present specification describes components and functionsimplemented in the embodiments with reference to particular standardsand protocols, the disclosure is not limited to such standards andprotocols. Each of the standards for Internet and other packet switchednetwork transmission (e.g., TCP/IP, UDP/IP, HTML, and HTTP) representexamples of the state of the art. Such standards are from time-to-timesuperseded by faster or more efficient equivalents having essentiallythe same functions. Wireless standards for device detection (e.g.,RFID), short-range communications (e.g., Bluetooth®, WiFi, ZigBee®), andlong-range communications (e.g., WiMAX, GSM, CDMA, LTE) can be used bycomputer system 900.

The illustrations of embodiments described herein are intended toprovide a general understanding of the structure of various embodiments,and they are not intended to serve as a complete description of all theelements and features of apparatus and systems that might make use ofthe structures described herein. Many other embodiments will be apparentto those of skill in the art upon reviewing the above description. Theexemplary embodiments can include combinations of features and/or stepsfrom multiple embodiments. Other embodiments may be utilized and derivedtherefrom, such that structural and logical substitutions and changesmay be made without departing from the scope of this disclosure. Figuresare also merely representational and may not be drawn to scale. Certainproportions thereof may be exaggerated, while others may be minimized.Accordingly, the specification and drawings are to be regarded in anillustrative rather than a restrictive sense.

Although specific embodiments have been illustrated and describedherein, it should be appreciated that any arrangement calculated toachieve the same purpose may be substituted for the specific embodimentsshown. This disclosure is intended to cover any and all adaptations orvariations of various embodiments. Combinations of the aboveembodiments, and other embodiments not specifically described herein,can be used in the subject disclosure. In one or more embodiments,features that are positively recited can also be excluded from theembodiment with or without replacement by another component or step. Thesteps or functions described with respect to the exemplary processes ormethods can be performed in any order. The steps or functions describedwith respect to the exemplary processes or methods can be performedalone or in combination with other steps or functions (from otherembodiments or from other steps that have not been described).

Less than all of the steps or functions described with respect to theexemplary processes or methods can also be performed in one or more ofthe exemplary embodiments. Further, the use of numerical terms todescribe a device, component, step or function, such as first, second,third, and so forth, is not intended to describe an order or functionunless expressly stated so. The use of the terms first, second, thirdand so forth, is generally to distinguish between devices, components,steps or functions unless expressly stated otherwise. Additionally, oneor more devices or components described with respect to the exemplaryembodiments can facilitate one or more functions, where the facilitating(e.g., facilitating access or facilitating establishing a connection)can include less than every step needed to perform the function or caninclude all of the steps needed to perform the function.

In one or more embodiments, a processor (which can include a controlleror circuit) has been described that performs various functions. Itshould be understood that the processor can be multiple processors,which can include distributed processors or parallel processors in asingle machine or multiple machines. The processor can be used insupporting a virtual processing environment. The virtual processingenvironment may support one or more virtual machines representingcomputers, servers, or other computing devices. In such virtualmachines, components such as microprocessors and storage devices may bevirtualized or logically represented. The processor can include a statemachine, application specific integrated circuit, and/or programmablegate array including a Field PGA. In one or more embodiments, when aprocessor executes instructions to perform “operations”, this caninclude the processor performing the operations directly and/orfacilitating, directing, or cooperating with another device or componentto perform the operations.

The Abstract of the Disclosure is provided with the understanding thatit will not be used to interpret or limit the scope or meaning of theclaims. In addition, in the foregoing Detailed Description, it can beseen that various features are grouped together in a single embodimentfor the purpose of streamlining the disclosure. This method ofdisclosure is not to be interpreted as reflecting an intention that theclaimed embodiments require more features than are expressly recited ineach claim. Rather, as the following claims reflect, inventive subjectmatter lies in less than all features of a single disclosed embodiment.Thus the following claims are hereby incorporated into the DetailedDescription, with each claim standing on its own as a separately claimedsubject matter.

What is claimed is:
 1. A probe device, comprising: a first wireless interface enabling communications via a first local area wireless access technology; a second wireless interface enabling communications via a second radio access technology; a processor coupled with the first and second wireless interfaces; and a memory that stores executable instructions that, when executed by the processor, facilitate performance of operations, comprising: receiving testing criteria and a testing schedule from a management portal server; initiating first and second groups of communication sessions according to the testing criteria and testing schedule, the first group of communication sessions being established via the first local area wireless access technology utilizing a distributed antenna system, and the second group of communication sessions being established via the second radio access technology utilizing the distributed antenna system; measuring performance data for the first and second groups of communication sessions according to the testing criteria; providing the performance data to the management portal server to enable adjustment of the distributed antenna system; receiving an upgrade command from the management portal server; and adjusting the executable instructions according to the upgrade command to generate adjusted executable instructions, wherein the adjusted executable instructions, when executed by the processor, facilitate performance of adjusted operations, comprising: initiating a third group of communication sessions via the first local area wireless access technology utilizing the distributed antenna system; measuring adjusted performance data for the third group of communication sessions; and providing the adjusted performance data to a network server to enable adjustment of the distributed antenna system, adjustment of a network providing communication services to a first location where the probe device is positioned, or a combination thereof.
 2. The probe device of claim 1, wherein the first and second groups of communication sessions comprise one of a voice call, messaging, a data upload, a data download, or a combination thereof, and wherein the processor comprises a plurality of processors operating in a distributed processing environment.
 3. The probe device of claim 2, wherein the testing schedule is uniformly periodic.
 4. The probe device of claim 2, further comprising: a single hardwire interface enabling the providing of the performance data to the network server, wherein the probe device receives power via the single hardwire interface, and wherein the operations further comprise: receiving command signals via the single hardwire interface; and adjusting operations of the probe device according to the command signals.
 5. The probe device of claim 4, wherein the providing of the performance data to the network server enables adjustment of network parameters for a network providing communication services to a first location where the probe device is positioned.
 6. The probe device of claim 1, wherein at least some of the first group of communication sessions overlap in time with at least some of the second group of communication sessions.
 7. The probe device of claim 1, wherein the adjusted executable instructions, when executed by the processor, facilitate performance of adjusted operations, comprising: initiating a fourth group of communication sessions, the fourth group of communication sessions via the second radio access technology utilizing the distributed antenna system; measuring adjusted performance data for the fourth group of communication sessions; and providing the adjusted performance data to the network server to enable adjustment of the distributed antenna system, adjustment of the network providing communication services to a first location where the probe device is positioned, or a combination thereof.
 8. The probe device of claim 1, further comprising a visual indicator that provides an indication representing an operational status of the probe device.
 9. The probe device of claim 1, wherein the measuring of the performance data for the first and second groups of communication sessions comprises establishing a separate thread for each of the first wireless interface and the second wireless interface.
 10. The probe device of claim 1, wherein the operations further comprise: receiving a power cycle reconfiguration command from the management portal server; cycling power and rebooting the probe device; and downloading a kernel and root file system.
 11. The probe device of claim 10, wherein the probe device downloads the kernel and root file system from the management portal server.
 12. The probe device of claim 10, wherein the operations further comprise adjusting an IP address associated with the probe device responsive to the power cycle reconfiguration command, wherein the rebooting is performed with the IP address; and wherein the downloading is from a second probe device.
 13. A method comprising: providing, by a system including a processor, test scripts to a plurality of probe devices; sending, by the system, commands to a first probe device in the plurality of probe devices to execute one or more test scripts of the test scripts provided to initiate first and second groups of data communication sessions, the first group of communication sessions being established via a local area wireless access technology utilizing a distributed antenna system, and the second group of communication sessions being established via a second radio access technology utilizing the distributed antenna system; receiving, by the system, performance data from the first probe device collected during the first and second groups of data communication sessions, the performance data being measured according to testing criteria set forth in the one or more test scripts and the commands; analyzing, by the system, the performance data; and adjusting, by the system, the distributed antenna system, a network providing communication services to a location where the first probe device is positioned, or a combination thereof, wherein the adjusting is based on the analyzing of the performance data; sending, by the system, a power cycle reconfiguration command to the plurality of probe devices, wherein the plurality of probe devices perform a power cycle and reboot; and providing, by the system, a kernel and root file system for downloading by the plurality of probe devices.
 14. The method of claim 13, wherein the first and second groups of data communication sessions comprise a data upload test, a data download test or a combination thereof, wherein the system includes a testing server, and wherein the testing server monitors activation of radio module identifications of the first probe device.
 15. The method of claim 14, wherein the data upload test comprises measuring a time to upload an image to Facebook, measuring ftp upload goodput, or a combination thereof.
 16. The method of claim 14, wherein the data download test comprises measuring http download throughput, http download goodput, ftp download goodput, or a combination thereof.
 17. The method of claim 13, wherein at least a portion of the first and second groups of data communication sessions overlap in time, wherein the testing criteria includes a testing schedule and types of tests to be performed by the probe device to obtain the performance data.
 18. A machine-readable storage medium, comprising executable instructions that, when executed by a processor of a probe device, facilitate performance of operations, comprising: initiating, by a first wireless interface of the probe device, a first group of data communication sessions according to testing criteria, the first group of data communication sessions being established via a local area wireless access technology utilizing a distributed antenna system; initiating, by a second wireless interface of the probe device, a second group of data communication sessions according to the testing criteria, the second group of data communication sessions being established via a second radio access technology utilizing the distributed antenna system; establishing a first thread for the first wireless interface and a second thread for the second wireless interface; measuring first performance data for the first group of data communication sessions according to the testing criteria utilizing the first thread; measuring second performance data for the second group of data communication sessions according to the testing criteria utilizing the second thread; receiving commands from a management portal server during execution of the first thread and the second thread; performing a command received during execution of the first thread and the second thread; receiving a power cycle reconfiguration command from the management portal server; cycling power and rebooting the probe device; and downloading a kernel and root file system.
 19. The machine-readable storage medium of claim 18, wherein performing the command comprises: sending test results after each test execution is completed, stopping execution of the first or second threads, restarting execution of the first or second threads, rebooting an Android handset connected to the probe device, starting an application on the Android handset, power cycling the Android handset, posting a current status of the probe device, posting test results to a database server, or a combination thereof, and wherein the processor comprises a plurality of processors operating in a distributed processing environment. 